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Abstract 

We  describe  three  data  structures  for  the  Priority  queue  with  attrition  (or  PQA), 
that  perform  each  PQA  operation  in  0(1)  worst  case  time.  Previous  implemen- 
tations of  the  PQA  required  0(1)  amortized  time  per  operation. 

1      Introduction 

A  Prxoniy  queue  with  aiintion  (PQA  for  short)  is  a  set  of  items,  each  having  a 
real  valued  key,  supporting  the  following  operations  : 

Createpqa:  Create  an  empty  PQA. 

Deletemin:  Delete  and  return  the  minimum  element  of  the  PQA. 

Insert(x):  Insert  a  new  item  x  into  the  PQA,  deleting  all  items  larger  than  or 
equal  to  x  from  the  PQA. 

Additionally,  we  might  want  to  perform  the  following  operations  on  the  PQA: 

FiNDMIN:  Return  the  minimum  item  in  the  PQA. 

Delete(x):  Given  the  position  of  item  x  in  the  data  structure,  delete  x. 

FiNDMiN  can  be  easily  incorporated  into  any  data  structure  for  the  PQA  sup- 
porting the  first  three  operations.  This  is  done  by  maintaining  the  minimum 
element  separately  and  representing  the  remaining  elements  of  the  PQA  using 
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the  data  structure.  Guaranteeing  an  0(1)  time  bound  for  Delete  is  usually 
more  difficult. 

The  priority  queue  with  attrition  crops  up  in  a  variety  of  applications.  The 
simplest  instance  of  its  use  is  in  implementing  a  minqtteue,  which  is  nothing  but 
a  queue  with  a  FiNDMiN  operation,  besides  insertions  at  the  rear  and  deletions  at 
the  front.  To  perform  FiNDMiN  efficiently,  we  maintain  a  sequence  xi,X2,  ■  ■  ■  ,Xk 
of  items,  such  that 

1.  Xi  is  the  smallest  item  in  the  queue,  and 

2-  Vi<j<i  Xi+i  is  the  smallest  item  to  the  rear  of  Zj. 

When  a  new  itemz  is  inserted,  if  ij  <  z  <  li+i,  then  the  items Xi+i,z,+2.  ■  ■  ■  ^Xk 
are  all  discarded,  and  x  is  appended  to  the  sequence.  Thus,  the  sequence  be- 
haves like  a  PQA,  and  our  data  structures  for  the  PQA  provide  implementations 
of  the  minqueue  requiring  0(1)  time  per  operation.  Gajewska  and  Tarjan  [3] 
offer  a  different  implementation  having  the  same  time  bound  for  the  minqueue 
operations.  FQAs  also  find  application  in  pagination  and  river  routing  [1,2,4,5]. 

It  is  easy  to  implement  the  PQA  using  0(1)  amortized  time  per  operation 
[1,4].  Maintain  the  items  of  the  PQA  in  a  queue  ordered  according  to  arrival 
time.  This  causes  the  queue  to  be  also  ordered  by  key.  Hence,  Deletemin 
simply  removes  and  returns  the  first  element  of  the  queue.  Insert(z)  scans  the 
queue  from  the  rear,  deleting  all  items  greater  than  or  equal  to  x,  and  inserts 
X  at  the  rear.  Since  an  item  can  get  deleted  at  most  once,  the  data  structure 
spends  only  0(1)  amortized  time  per  operation. 

Is  there  a  data  structure  for  the  PQA  that  requires  only  0(1)  time  per 
operation  in  the  worst  case?  We  answer  the  question  in  the  affirmative  by 
providing  three  0(1)  worst  case  time  data  strutures  for  the  PQA.  Section  2 
describes  a  data  structure  with  0(1)  amortized  time  per  operation,  which  is 
an  useful  stepping  stone  in  the  derivation  of  the  worst  case  data  structures.  In 
sections  3,  4,  and  5,  we  derive  the  worst  case  data  structures  by  modifying  the 
amortized  data  structure.  The  last  section  discusses  a  related  problem.  We 
introduce  some  definitions  and  notations  in  the  rest  of  this  section. 

An  item  of  a  queue  is  clean,  if  it  is  smaller  than  all  the  items  to  its  rear, 
and  dirty,  otherwise.  Call  a  queue  clean,  if  all  its  items  are  clean,  i.e.  the  items 
increase  in  key  from  the  front  to  the  rear.  We  say  a  queue  Q  represents  a  set  of 
items  S,  if  5  equals  the  set  of  clean  items  of  Q.  For  any  two  queues  Qi  and  Q2, 
by  Qi  <  Q2.  we  mean  that  the  items  in  Qi  are  smaller  than  the  items  in  Q2. 

For  any  queue  <?  =  (91, 92.  •  •  ■ .  9n)  with  qi  as  the  first  element,  let 

first(g)  =  qi 
last(Q)  =  q„ 
rest(Q)  =  (?2.93---,9n) 


D 
Insert^     |  Clean  up 


Deletemin 


mm(D) 


Figure   1:     The   amortized   data  structure.      Darkening  signifies  the   lack  of 
key-order,  and  the  arrows  denote  the  data  paths  for  the  movement  of  itenns. 


min(Q)  =  a  smallest  item  of  Q 

Q  II  (9n  +  l,  •  •  •  ,qn  +  m)  =  (fll.  ■  •  ■,qn,qn+l,  ■■  ■  ,  9n  +  m) 

IQI  =  n. 

Define  the  queue  operations 

Deletefirst(Q):  Delete  and  return  first(Q). 

Deletelast(Q):  Delete  and  return  last(Q). 

Pass(Qi,(52):  Pass  first((5i)  to  the  rear  of  Q2 

Passback(Qi,Q2):  Pass  back  last(Qi)  to  the  front  of  Q2- 

Each  queue  operation  can  be  performed  in  0(1)  time,  if  we  represent  a  queue 
by  a  doubly  linked  list  with  pointers  to  the  first  and  last  nodes. 
The  concurrent  assignment  statement 

fi,f2>---,fn  :=  ei, 62, ■■■,€„ 

first  evaluates  the  expressions  ei,...,en  and  then  assigns  their  values  to  the 
variables  vi, . . . ,  t)„. 

2     The  amortized  data  structure 

The  amortized  data  structure  has  a  clean  queue  C,  from  which  the  minimum 
element  is  always  deleted,  and  a  "dirty"  queue  D,  to  which  new  items  are  added. 
Whenever  Deletemin  finds  the  minimum  item  of  the  PQA  in  D,  a  clean  up 
process  recreates  C  from  D,  by  stripping  off  dirty  items.  See  figure  1. 
Formally,  the  following  invariants  are  maintained: 

1.  C  \\  D  represents  the  PQA. 

2.  C  is  clean. 

3.  first(D)  =  min(D). 


The  operations  are  implemented  as  follows: 

Createpqa  = 
CD  :=(),() 

Insert(x)  = 

if  D^  ()candfirst(£>)  >  ar    then 

{  Delete  all  existing  items  of  D\  add  x  to  D  } 
D:={x) 
else  D:=  D\\  {x) 

Deletemin  = 

{  Ensure  that  C  ^  (),  and 

D#  ()=>first(C)  <  first(D)  } 
if  (D  5it  0  and  C  i^  ())  cand  first(C)  >  first(D)    then 
{  Destroy  C  } 
C:=() 
if  C=  0    then 

Clean  up  D  and  transfer  its  contents  to  C. 
return  Deletefirst(C) 

D  can  be  cleaned  up  in  C>(|D|)  time  in  a  single  forward  or  backward  scan.  The 
forward  scheme  scans  D  from  the  front  to  the  rear,  and  at  each  item  x,  deletes 
larger  or  equal  items  to  the  front  of  x.  The  backward  scheme  scans  D  in  reverse, 
deleting  each  item  with  a  smaller  or  equal  successor.  Since  clean  up  costs  only 
0(1)  time  per  item,  this  data  structure  requires  only  0(1)  amortized  time  per 
operation.  DELETE  simply  marks  the  deleted  item;  marked  items  are  deleted 
when  they  appear  at  the  front  of  C. 

3     Worst  case  data  structure  1 

We  convert  the  amortized  data  structure  into  a  worst  case  data  structure  by 
overlapping  the  PQA  operations  with  the  clean  up  operation,  and  systematically 
transferring  clean  items  from  the  dirty  queue  to  the  clean  queue.  We  also  ensure 
that  the  minimum  element  of  the  PQA  is  at  the  front  of  the  clean  queue  as  far  as 
possible.  In  this  section,  we  apply  the  forward  scheme  for  clean  ups,  and  derive 
our  first  data  structure  requiring  0(1)  time  per  operation.  The  worst  case  data 
structure  presented  in  the  next  section  is  derived  by  using  the  backward  clean 
up  scheme  to  clean  up  the  dirty  queue. 

During  the  forward  clean  up  scheme,  the  dirty  queue  gets  divided  into  a 
clean  front  portion  £)/,  and  a  rear  portion  Dr,  that  is  waiting  to  be  cleaned 
up.  At  the  beginning,  Dj  -  (),  and  Dr  =  D.  Each  clean  up  step  either 
transfers  first(Dr)  to  the  rear  of  Df,  or  deletes  last(D;),  depending  on  whether 
last(Dy)  <  first(Dr),  or  not.  At  any  stage,  the  algorithm  needs  to  perform  at 


Insert 


Deletemin 


Figure  2:  Worst  case  data  structure  1 


most  2\Dr\  +  \Dj\  clean  up  steps  before  it  can  finish.  In  order  to  always  have 
the  minimum  element  of  the  PQA  at  the  front  of  C,  we  impose  the  constraints 
that  C  contain  only  items  smaller  than  the  items  of  the  other  queues,  and  that 
\C\  >  2\Dr\  +  \D/\.  New  items  are  usually  appended  to  Dr-  Inserting  an  item 
that  is  smaller  than  some  of  the  items  of  C  will  then  violate  the  minimality  of  the 
items  in  C.  This  problem  is  resolved  by  pushing  back  the  items  in  rest(C)  into  a 
buffer  B,  and  retaining  first(C)  in  C,  after  checking  that  first(C)  is  smaller  than 
the  inserted  item.  Whenever  Dr  =  (),  items  are  successively  transferred  from 
B  to  C,  until  first(S)  >  first(D/).  Then,  B  is  emptied,  and  Dj  is  appended  to 
C.  See  figure  2. 

More  formally,  the  worst  case  data  structure  maintains  the  queues  C,B,Dj, 
and  Dr  under  the  following  invariants: 

1.  C  II  B  II  D/  II  Dr  represents  the  PQA. 

2.  C,B,  and  Df  are  clean,  and  C  <  S  ||  Dj  \\  Dr. 

3.  Bias:  |C|  >  2|r»r|  +  |D/|. 

Insert  and  Deletemin  can  upset  the  bias,  which  is  restored  by  performing 
the  following  BlAS  operation  as  many  times  as  necessary: 

Bias  = 

ifDr^^O    then 
{  Clean  up  step  } 

M  Dj  i^{)  cand  last(L>/)  >  first(Dr)    then 

Deletelast(Z?/)  {  decrease  \D]\  ] 

else  PKSS{Dr,Dj)  {  decrease  |Dr|;  increzise  \D}\  } 

else  if  Dy  ^  0  cand  (B  =  ()  cor  first(S)  >  first(Dy))    then 

Df,B,C  :=  (),(),  C  II  Dj  {  decrease  |D/|;  increase  \C\  } 

elseiffl^O    then  Pass(B,C)  {  increase  jCj} 

{  else  B  =  Dj  =  Dr  =  {)  } 

Bias  increases  |C|  —  2|Dr|  —  \Df\  by  at  least  1,  if  any  of  the  queues  B,Df,  and 
Dr  is  nonempty.  This  is  accomplished  by  either  performing  a  clean  up  step,  or 
passing  an  item  from  B  to  C,  or  appending  the  items  of  Dj  to  C.  Hence,  an 
Insert  must  be  followed  by  two  Biass  and  a  Deletemin  by  one  Bias. 


The  implementation  of  the  PQA  operations  is  now  straightforward: 

Createpqa  = 

C,B,  £>;,£>,  :=(),(),(),() 

iNSERT(r)  = 

ifC^i)  cand  first(C)  >  i    then 

{  Delete  all  existing  items;  add  r  to  C  } 
C,B,D,,Dr:=iz), {),{),() 
else  ifC^i)  cand  last(C)  >  x    then 

{  Empty  B,Dj,  and  Dr',  Push  back  rest(C)  into  B;  add  x  to  Dj  } 
C, B, Df,Dr  :=  (first(C)), rest(C), (x), () 
else  Dr  :=  Dr  \\  (x) 
Bias;  Bias 

Deletemin  = 
Bias 
return  Deletefirst(C) 

{  Bias  ensures  that  C  ^  (),  unless  the  PQA  is  empty  } 


It  is  evident  thai  the  implementation  of  the  operations  is  correct,  and  that 
each  operation  requires  only  0(1)  time  in  the  worst  case.  In  practice,  instead 
of  maintaming  the  queues  C,B,Df,  and  Dr  as  four  separate  lists,  it  is  more 
efficient  to  maintain  a  single  doubly  Unked  list  representing  C  ||  S  ||  Dj  \\  Dr 
with  pointers  to  first(C),  first(fl),  fiist{Dj),  first(£)r)  and  the  last  node. 

How  is  Delete  handled?  If  the  deleted  item  belongs  to  B  or  C,  it  is  imme- 
diately deleted,  and  one  Bias  is  performed  if  it  was  deleted  from  C.  If  it  is  in  Dj 
or  Dr,  the  item  is  just  marked,  and  is  deleted  only  when  it  enters  C.  This  calls 
for  a  modification  of  Bias:  where  Dj  is  appended  to  C,  instead  of  appending 
the  whole  of  D/,  it  suffices  to  move  just  one  item  to  C,  namely  first(Z)/),  and 
if  first(Dy)  is  marked,  it  is  deleted  instead. 

4     Worst  case  data  structure  2 

In  the  course  of  the  backward  clean  up  scheme,  the  dirty  queue  is  partitioned 
into  a  clean  rear  portion  Dr,  and  a  front  portion  Df,  awaiting  cleaning.  To 
start  with,  Dr  =  (),  and  Dj  =  D.  Each  clean  up  step  either  transfers  last(D/) 
to  the  front  of  Dr,  or  deletes  \ast{Df),  based  on  whether  last(Dy)  <  first(Z?r), 
or  not.  While  clean  up  is  in  progress,  new  arrivals  are  batched  into  a  separate 
dirty  queue  DD.  After  the  current  clean  up  phase  completes,  the  items  of  Dr 
are  gradually  transferred  to  C,  until  mm{DD)  <  first(Dr).  At  this  point,  the 
rest  of  the  items  of  Dr  are  discarded,  the  contents  of  DD  are  transferred  to 
Dj,  and  the  next  clean  up  phase  is  commenced.    Thus,  the  total  volume  of 
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Figure  3:  Worst  case  data  structure  2. 

residual  clean  up  work  left  at  any  instant  is  at  most  \DD\  +  \Dj\.  As  before, 
the  items  of  C  are  the  smallest  items  among  all  items  in  the  data  structure, 
and  \C\  >  \DD\  +  \Df\.  Dr  also  plays  the  role  of  the  push  back  buffer.  When 
the  inserted  item  is  smaller  than  some  of  the  items  of  C,  the  queues  DD,Dr, 
and  Df  are  all  emptied,  the  items  in  re8t(C)  are  pushed  back  into  Dr,  and  the 
arriving  item  is  put  in  DD.  See  figure  3. 

Formally,  the  queues  DD,Dr,Df,  and  C  satisfy  the  following  conditions: 

1.  C  II  Z?/  II  Dr  II  DD  represents  the  PQA. 

2.  C  and  Dr  are  clean,  and  C  <  Dj  \\  Dr  \\  DD. 

3.  first(DD)  =  min{DD). 

4.  Bias:  |C|  >  |£»L>|  +  |D/|. 

Operation  BlAS  takes  the  form: 

Bias  = 

if  Df  :^i)    then 
{  Clean  up  step  } 

if  D,  =  0  cor  first(Dr)  >  last(D/)    then 

PASSBACK(Z?;,Dr)  {  decrease  |D/|  } 

eke  Deletelast(Z?/)  {  decrease  \Dj\  } 

else  if  Dr^O  cand  {DD  =  ()  cor  first(Dr)  <  first(£)D))    then 

PASS(Dr,C)  {  increase  |C|  } 

else  if  DD^  {)    then 

{  Destroy  Dr;  initiate  a  new  clean  up  process  } 

Pass{DD,C)  {  decrease  \DD\;  increase  |C|  } 

DD,Dr,Df  :={),{),  DD 
{  else  Dj  =  Dr  =  DD  =  i)  } 


Bias  increases  |C|  —  \DD\  —  \Df\  by  at  leeist  1,  whenever  at  least  one  of  DD,Dr, 
and  Df  is  nonempty.  This  is  accomplished  by  either  performing  a  clean  up  step, 
or  paissing  an  item  from  Dr  to  C,  or  initiating  a  new  clean  up  phase.  INSERT  and 


Deletemin  require  only  one  Bias  each,  since  both  increase  \C\  —  \DD\  —  \D]\ 
by  at  most  1. 

The  operations  of  the  PQA  follow: 

Createpqa  = 

C,Z)/,£»„D£>  :=(),(),(),() 

t 

Insert(x)  = 

if  C  9^  0  cand  first(C)  >  x   then 
{  Destroy  all  queues;  add  a;  to  C  } 
C,D;,r»„DD:=(x),  (),(),() 
else  if  C  ^  0  cand  last(C)  >  x    then 

{  Destroy  D},Dr,  and  DD,  push  back  re8t(C)  into  Dr\ 
add  z  to  DD  } 

C,  Dj,  Dr,  DD  :=  (first(C)),  (),  rest(C),  (z) 
eke  \S  DD^  {)  cand  first(DD)  >  x    then 
{  Destroy  DD\  add  x  to  DD  } 
DD  :=  (i) 
else  DD  :=  DD  ||  (x) 
Bias 

Deletemin  = 
Bias 
return  Deletefirst(C) 

{Bias  ensures  that  C  ^  (),  unless  the  PQA  b  empty  } 

This  concludes  the  description  of  the  second  worst  case  data  structure.  It 
is  eeisy  to  verify  that  the  operations  are  performed  correctly,  and  require  only 
0(1)  time.  Delete  can  be  added  to  the  repertoire  of  operations  as  before. 

5     Worst  Ccise  data  structure  3 

Instead  of  cleaning  up  the  dirty  queue  by  scanning  it  in  a  fixed  direction,  we 
can  perform  the  clean  up  steps  at  arbitrary  positions  in  the  middle  of  the  dirty 
queue.  For  this,  we  partition  the  dirty  queue  D  into  a  sequence  of  clean  queues 
Di,D2,...,Dt  such  that,  Dj  ||  Dj  ||  •••  ||  Dt  represents  the  PQA.  A  clean  up 
step  either  combines  two  adjacent  queues  D^  and  D,+i  into  a  single  queue  by 
concatenation,  or  deletes  the  last  item  of  a  queue  D,-,  or  deletes  an  empty  queue 
Di,  maintaining  the  queues  clean.  The  amount  of  work  needed  to  reduce  all  the 

queues  into  a  single  clean  queue  is  at  most  |Di|  + h  \Dk\  +  k,  yielding  the 

bias  condition  |C|  >  |Di|  + h  |Di|  +  it.  A  new  item  x  is  added  by  creating 

a  singleton  queue  Qt+i  =  (x).  A  push  back  buffer  B  is  needed  as  in  worst  case 
data  structure  1.  The  details  of  the  operations  can  be  worked  out  as  before. 


6      Conclusion 

The  key  to  the  success  of  our  worst  case  data  structures  is  the  bias  condition, 
which  ensures  that  the  query  value  (the  minimum  item,  here)  will  be  eaisily 
computable  even  though  the  construction  of  the  data  structure  is  not  complete. 
The  data  structure  invariants  are  chiefly  responsible  for  managing  the  complex 
data  movement  elegantly. 

Not  every  data  structure  with  a  good  amortized  performance  has  a  coun- 
terpart with  a  matching  worst  case  performance.  The  Pnonty  stack  wtih  at- 
tntton{PSA)  is  a  data  structure  whose  only  difference  from  the  PQA  is  that 
Insert  now  deletes  the  items  that  are  smaller  than  or  equal  to  the  inserted 
item.  Surprisingly,  the  PSA  does  not  have  an  0(1)  worst  case  time  data  struc- 
ture. To  see  this,  consider  the  following  neighbour  search  problem,  where  we  are 
given  n  reals  Xi,  X2, . . . ,  x„,  and  we  want  to  preprocess  them,  and  answer  one 
query,  which  asks  for  the  smallest  real  in  the  set  larger  than  the  query  number 
X.  Any  data  structure  for  this  problem  must  spend  Q(log(n))  time  on  some 
query  under  the  decision  tree  model.  We  can  solve  this  problem  by  building  a 
PSA  of  the  numbers  by  inserting  them  in  decreasing  order  (preprocessing)  and 
then  inserting  x  and  performing  two  Deletemins  (query  processing).  Thus, 
either  Insert  or  Deletemin  costs  logarithmic  time,  in  any  data  structure  for 
the  PSA.  This  bound  is  tight,  since  the  PSA  has  an  implicit  data  structure,  with 
0{\og{d))  time  for  Insert,  where  d  =  the  number  of  deleted  items,  and  0(1) 
time  for  DELETEMIN.  Maintain  the  PSA  contiguously  in  an  array,  such  that 
the  items  are  in  key-order.  INSERT  performs  an  expanding  binary  search  of  the 
item  list,  starting  from  the  smallest  item,  and  inserts  the  new  item  at  the  right 
place.  That  is,  the  inserted  item  is  successively  compared  to  the  smallest  item, 
the  second  smallest  item,  the  fourth  smallest  item,  and  so  on,  until  a  larger  item 
is  found.  The  exact  position  of  the  inserted  item  is  located  by  a  binary  search 
of  the  subUst  between  the  last  two  comparands. 
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